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Abstract 

The complexity of graph homomorphism problems has been the subject of intense study. It is 
a long standing open problem to give a (decidable) complexity dichotomy theorem for the partition 
function of directed graph homomorphisms. In this paper, we prove a decidable complexity dichotomy 
theorem for this problem and our theorem applies to all non-negative weighted form of the problem: 
given any fixed matrix A with non- negative algebraic entries, the partition function Z&_{G) of directed 
graph homomorphisms from any directed graph G is either tractable in polynomial time or $:P-hard, 
depending on the matrix A. The proof of the dichotomy theorem is combinatorial, but involves the 
definition of an infinite family of graph homomorphism problems. The proof of its decidability is 
algebraic using properties of polynomials. 
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1 Introduction 



The complexity of counting graph homomorphisms has received much attention recently El El E 
[6]. The problem can be defined for both directed and undirected graphs. Most results have been obtained 
for undirected graphs, while the study of complexity of the problem is significantly more challenging for 
directed graphs. In particular, Feder and Vardi showed that the decision problems defined by directed 
graph homomorphisms are as general as the Constraint Satisfaction Problems (CSPs), and a complexity 
dichotomy for the former would resolve their long standing dichotomy conjecture for all CSPs |10j . 

Let G and H be two graphs. We follow the standard definition of graph homomorphisms, where G 
is allowed to have multiple edges but no self loops; and H can have both multiple edges and self loops.0 
We say £ : V(G) —> V(H) is a graph homomorphism from G to H if £(u)£(v) is an edge in E{H) for all 
uv 6 E(G). Here if H is an undirected graph, then G is also an undirected graph; if H is directed, then 
G is also directed. The undirected problem is a special case of the directed one. 

For a fixed H, we are interested in the complexity of the following integer function Zjj(G): The input 
is a graph G, and the output is the number of graph homomorphisms from G to H. More generally, we 
can define Z\(-) for any fixed m x m matrix A = (Aij): 



Note that the input G is a directed graph in general. However, if A is a symmetric matrix, then one can 
always view G as an undirected graph. Moreover, if A is a {0, l}-matrix, then Z&_(-) is exactly Zh(-), 
where H is the graph whose adjacency matrix is A. 

Graph homomorphisms can express many interesting counting problems over graphs. For example, if 
we take H to be an undirected graph over two vertices {0, 1} with an edge (0, 1) and a loop (1, 1) at 1, 
then a graph homomorphism from G to H corresponds to a Vertex Cover of G, and Zjj(G) is simply 
the number of vertex covers of G. As another example, if H is the complete graph on k vertices without 
self loops, then Zjj(G) is the number of /c-Colorings of G. In [IT], Freedman, Lovasz, and Schrijver 
characterized what graph functions can be expressed as Z &.(•)■ 

For increasingly more general families C of matrices A, the complexity of Z&(-) has been studied and 
dichotomy theorems have been proved. A dichotomy theorem for a given family C of matrices A states 
that for any A £ C, the problem of computing Za(") is either in polynomial time or #P-hard. A decidable 
dichotomy theorem requires that the dichotomy criterion is computably decidable: There is a finite-time 
classification algorithm that, given any A G C, decides whether Zj^(-) is in polynomial time or #P-hard. 
Most results have been obtained for undirected graphs. 

Symmetric matrices A, and Z&{G) over undirected graphs G: 

In [131 114j . Hell and Nesetfil showed that given any symmetric {0, 1} matrix A, deciding whether Zj^(G) 
> is either in P or NP-complete. Then Dyer and Greenhill [8] showed that given any symmetric {0,1} 
matrix A, the problem of computing Za(-) is either in P or #P-complete. Bulatov and Grohe generalized 
their result to all non-negative symmetric matrices A [5jH They obtained an elegant dichotomy theorem 
which basically says that Zj^(-) is in P if every block of A has rank at most one, and is #P-hard otherwise. 
In [12] Goldberg, Grohe, Jerrum and Thurley proved a beautiful dichotomy for all symmetric real matrices. 
Finally, a dichotomy theorem for all symmetric complex matrices was recently proved by Cai, Chen and 



1 However, our results are actually stronger in that our tractability result allows for loops in G, while our hardness result 
holds for G without loops. 

2 More exactly, they proved a dichotomy theorem for symmetric matrices A in which every entry Aij is a non-negative 
algebraic number. Our result in this paper applies similarly to all non-negative algebraic numbers, and throughout the paper 
we use R to denote the set of real algebraic numbers. 
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Lu |Bj. We remark that all these dichotomy theorems for symmetric matrices above are polynomial-time 
decidable, meaning that given any matrix A, one can decide in polynomial time (in the input size of A) 
whether Za(") is in P or #P-hard. 

General matrices A, and Z\{G) over directed graphs G: 

In a paper that won the best paper award at ICALP in 2006, Dyer, Goldberg and Paterson [7] proved a 
dichotomy theorem for directed graph homomorphism problems Z#(-), but restricted to directed acyclic 
graphs H. They introduced the concept of Lovdsz-goodness and proved that Zh(-) is in P if the graph H 
is Zayeredd and Lovdsz-good, and is ^P-hard otherwise. The property of Lovasz-goodness turns out to be 
polynomial-time decidable. 

In PQ, Bulatov presented a sweeping dichotomy theorem for all counting Constraint Satisfaction Pro- 
blems. Recently Dyer and Richerby [9] obtained an alternative proof. The dichotomy theorem of Bulatov 
then implies a dichotomy for Zh(-) over all directed graphs H. However, it is rather unclear whether this 
dichotomy theorem is decidable or not. The criterion requires one to check a condition on an infinitary 
object (see Appendix [H] for details). This situation remains the same for the Dyer- Richerby proof in [9]. 
The decidability of the dichotomy was then left as an open problem in [2] . 

In this paper, we prove a dichotomy theorem for the family of all non-negative real matrices A. We 
show that for every fixed mxm non-negative matrix A, the problem of computing Za(-) is either in P or 
#P-hard. Moreover, our dichotomy criterion is decidable: we give a finite-time algorithm which, given any 
non-negative matrix A, decides whether Zj^(-) is in P or #P-hard. In particular, for the family of {0, 1} 
matrices our result gives an alternative dichotomy criterion^ to that of Bulatov [2] and Dyer- Richerby [9] , 
which is decidable. 

The main difficulty we encountered in obtaining the dichotomy theorem is due to the abundance 
of new intricate but tractable cases, when moving from acyclic graphs to general directed graphs. For 
example, H does not have to be layered for the problem Zh{ ) to be tractable (see Figure [1] in Appendix 
[A] for an example). Because of the generality of directed graphs, it seems impossible to have a simply 
stated criterion (e.g., Lovasz-goodness, as was used in the acyclic case [7J) which is both powerful enough 
to completely characterize all the tractable cases and also easy to check. However, we manage to find a 
dichotomy criterion as well as a finite-time algorithm to decide whether A satisfies it or not. 

In particular, the dichotomy theorem of Dyer, Goldberg and Paterson [7] for the acyclic case fits into 
our framework as follows. In our dichotomy we start from A and then define, in each round, a (possibly 
infinite) set of new matrices. The size of the matrices defined in round i + 1 is strictly smaller than that 
of round i (so there could be at most m rounds). The dichotomy then is that ^a(') is in P if and only if 
every block of any matrix defined in the process above is of rank 1 (see Section [1.11 and 11.21 for details). 
For the special acyclic case treated by Dyer, Goldberg and Paterson [7J, let A be the adjacency matrix 
of H which is acyclic and has k layers, then at most k rounds are necessary to reach a conclusion about 
whether Zj^(-) = Zfj(-) is in P or ^P-hard. However, when H has k layers but is not acyclic (i.e., there 
are edges from layer k to layer 1), deciding whether Z&_(-) is in P or #P-hard becomes much harder in 
the sense that we might need 3> k rounds to reach a conclusion. 



3 A directed acyclic graph is layered if one can partition its vertices into k sets V%, . . . ,Vk, for some k > 1, such that every 
edge goes from V% to Vi+i for some i : 1 < i < k. 

4 A dichotomy criterion is a well-defined mathematical property over the family of matrices A being considered such that 
Za(-) is in P if A has this property; and is #P-hard otherwise. 

5 Both our dichotomy criterion (when specialized to the {0, 1} case) and the one of Bulatov characterize {0, 1} matrices A 
with Za(-) in P and thus, they must be equivalent, i.e., A satisfies our criterion if and only if it satisfies the one of Bulatov. 
As a corollary, our result also implies a finite-time algorithm for checking the dichotomy criterion of Bulatov [2] (and the 
version of Dyer and Richerby [9]) for the case of {0, 1} matrices A. 
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After we circulated a draft of this paper, Goldberg informed us that she and coauthors [4J found a 
reduction from weighted counting CSP with non-negative rational weights to the 0-1 dichotomy theorem 
of Bulatov [2j. However, the combined result still only works for non-negative rational weights and more 
importantly, the dichotomy is not known to be decidable. 

1.1 Intuition of the Dichotomy: Domain Reduction 

Let A be the m x m non-negative matrix being considered, and G = (V, E) be the input directed graph. 
Before giving a more formal sketch of the proofs, we use a simple example to illustrate one of the most 
important ideas of this work: domain reduction. 

For this purpose we also need to introduce the concept of labeled directed graphs. A labeled directed 
graph Q over domain [m] = {1,2, . . . , m} is a directed graph, in which every directed edge e is labeled 
with an m x m matrix A^; and every vertex v is labeled with an m-dimensional vector w'"l Then the 
partition function of Q is defined as 

*«o= E IH(1> n<v 

£:V->[m] veV uv£E 

In particular, we have Za(G) = Z(Go) where Go has the same graph structure as G; every edge of Go is 
labeled with the same A; and every vertex of Go is labeled with 1, the m-dimensional all-1 vector. 

Roughly speaking, starting from the input G, we build (in polynomial time) a finite sequence of new 
labeled directed graphs Go, Gi, G2, ■ ■ ■ ,Gh one by one. Gk+i is constructed from Gk by using the domain 
reduction method which we are going to describe next. On the one hand, the domains of these labeled 
graphs shrink along with k. This means, the size of the edge weight matrices associated with the edges 
of Gk ( or equivalently, the dimension of the vectors associated with the vertices of Gk) strictly decreases 
along with k. On the other hand, we have Z(Gk+i) = Z(Gk) f° r all > and thus, 

Z A (G) = Z(Go) = -.. = Z(G h ). 

Since the domain size decreases monotonically, the number of graphs Gk in this sequence is at most m. 
To prove our dichotomy theorem, we show that, either something bad happens which forces us to stop 
the domain reduction process, in which case we show that Za(-) is #P-hard; or we can keep reducing the 
domain size until the computation becomes trivial, in which case we show that Zj^(-) is in P. 

We say a matrix A is block-rank-1 if one can (separately) permute the rows and columns of A to get 
a block diagonal matrix in which every block is of rank at most 1. If A is not block-rank-1 we can easily 
show that Zj^(-) is #P-hard, using the dichotomy of Bulatov and Grohe [5] for symmetric non- negative 
matrices (see LemmaH]). So without loss of generality, we assume A is block-rank-1. For example, let A 
be the 8x8 block rank-1 non-negative matrix in Figure [2] in Appendix [X] with 16 positive entries. Then 
we use T = {(Ai, B{), (A%, B2), (A3, B3), (A4, B^)} to denote the block structure of A, where 

VsG[4], A s = {2s - 1,2s}, Si = {1,3}, B 2 = {5,7}, £3 = {2,4} and B 4 = {6,8}, 

so that Aij > if and only if i E A s and j £ B s , for some s G [4]. Because A is block-rank-1, there also 
exist two 8-dimensional positive vectors a and (3 such that 

Aij = ai ■ /3j, for all (i, j) such that i E A s and j E B s for some s E [4]. 

Now let G = (V, E) be the directed graph in Figure [31 where \V\ = 6 and \E\ =6. We illustrate the 
domain reduction process by constructing the first labeled directed graph Gi in the sequence as follows. 
To simplify the presentation, we let y E [8] 6 (instead of £ : V — > [8]) denote an assignment, where yi E [8] 
denotes the value of vertex i in Figure [3] for every i E [6] . 
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First, let y G [8] 6 be any assignment with a nonzero weight: A yi>y . > for every edge ij G E. Since 
A has the block structure T, for every ij G E, there exists a unique index s G [4] such that yi G A s and 
j/j G This inspires us to introduce a new variable X£ G [4] for each edge ei G E, I G [6] (as shown in 
Figure [3j). For every possible assignment of x = {x\,X2, ■ ■ ■ ,x§) G [4] 6 , we use Y[x] to denote the set of 
all possible assignments y G [8] 6 such that for every eg = ij, yi G A x . and yj G B Xl . Now we have 

Za{g)= E wt (y)' where wt (y) = II A y*>yy 

xG[4] 6 yey[x] ije£ 

Second, we further simplify the sum above by noticing that if X2 ^ x% in x, then Y[x] must be empty 
because the two edges e<i and e 3 share the same tail in G. In general, we only need to sum over the case 
when xi = X2 = £3 and X4 = X5, since otherwise the set Y[x] is empty. As a result, 

Za(G) = E E wt ^)- 

x!=x 2 =x 3 veYfxl 
14=2:5 J 11 

x 6 

The advantage of introducing xg, i G [6], is that, once x is fixed, one can always decompose A yit y. as 
a product a Vi ■ /L., for all y G Y[x] and all ij G -E, since y belonging to Y[x\ guarantees that (yi,yj) falls 
inside one of the four blocks of A. This allows us to greatly simplify wt(y): If y G Y[x], then 

W t(y) = Ay 1>y3 ■ A yij y 2 • Ay 2i y 3 ' Ay^^y^ ' Ay^^ • Ay & = CKy j /^g Ofyj /3y 2 ^3 Ofyg Ofyg /Jyg Oyg /^g . 

Also notice that Y[x], for any x, is a direct product of subsets of [8]: y G Y[x] if and only if 

vi g Li = Adi, 2/2 g l 2 = ^ 3 n S X1 = n y 3 g L 3 = 4c 4 n A^ n 5 X2 n s x . 3 = A X4 n 5 X1 

y 4 G Li = B X4 ,y 5 G L 5 = A^ n B X/k ,y 6 G L 6 = R^. 
As a result, Za(G) becomes 

^a(G) = ^ E {{ a vif a v^y2) ■ ((% 3 ) 2 (A/ 3 ) 2 ) • Am • (<%A/ S ) ■ /V (!) 
n,x4.x6 j/jeii,ie[6] 

Finally we construct the following labeled directed graph Q\ over domain [4]. There are three vertices 
a,b and c, which correspond to x\,X4 and xq, respectively; and there are two directed edges ab and be. 
We construct the weights as follows. The vertex weight vector of a is 



[a 

We 



E ( a v^ 2 ' ("vaPw)' f or every £ G [4]; 



the vertex weights of b and c are the same: 



[b] [c] 

wy =wy 



^ j3 y , for every £ G [4]. 

yeB e 



The edge weight matrix C ^ of afr is 

C U= E Ka) 2 ^) 2 , far all Me [4]; 
y 3 £B k nA e 

and the edge weight matrix C^ c l of 6c is 

Clj= E "wA*. for all k,£ & [4]. 
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Using ([T|) and the definition of Z(Qi), it is easy to verify that Z\(G) = Z{Q{) and thus, we reduced the 
domain size of the problem from 8 (which is the number of rows and columns in A), to 4 (which is the 
number of blocks in A). However, we also paid a high price. Two issues are worth pointing out here: 

1. Unlike in Za_(G), different edges in Q\ have different edge weight matrices in general. For example, 
the matrices associated with ab and be are clearly different, for general a and (3. Actually, the set 
of matrices that may appear as an edge weight of Q\, constructed from all possible directed graphs 
G after one round of domain reduction, is infinite in general. 

2. Unlike in Za(G), we have to introduce vertex weights in Q\. Similarly, vertices may have different 
vertex weight vectors, and the set of vectors that may appear as a vertex weight of Qi, constructed 
from all possible G after one round of domain reduction, is infinite in general. 

It is also worth noticing that even if the matrix A we start with is {0, 1}, the edge and vertex weights of 
Qi immediately become rational right after the first round of domain reduction and we have to deal with 
rational weights afterwards. So {0, l}-matrices are not that special under this framework. 

These two issues cause us a lot of trouble because we need to carry out the domain reduction process 
for several times, until the computation becomes trivial. However, the reduction process above crucially 
used the assumption that A is block-rank-1 (otherwise one cannot replace A{ with «j • /3A Therefore, 
there is no way to continue this process if some edge weight matrix in Q\ is not block-rank-1. To deal 
with this case, we show that if this happens for some G, then Zj^(-) is #P-hard. Informally, we have 

Theorem 1 (Informal) . For any G, if one of the edge matrices in (constructed from G after k rounds 
of domain reductions), for some k > 1, is not block-rank-1, then Z&(-) is #P-hard. 

The proof of Theorem Q] for k = 1 is relatively straight forward, because every edge weight matrix in 
G is A. However, due of the two issues mentioned earlier, the edge weights and vertex weights of Q\ are 
drawn from infinite sets in general, and even proving it for k = 2 is highly non-trivial. 

Even with Theorem [T] which essentially gives us a dichotomy theorem for all non-negative matrices, it 
is still unclear whether the dichotomy is decidable or not. The difficulty is that, to decide whether ^a(') 
is in P or #P-hard, we need to check infinitely many matrices (all the edge weight matrices that appear 
in the domain reduction process, from all possible directed graphs G) and to see whether all of them are 
block-rank-1. To overcome this, we give an algebraic proof using properties of polynomials. We manage 
to show that it is not necessary to check these matrices one by one, but only need to check whether or 
not the entries of A satisfy finitely many polynomial constraints. 

1.2 Proof Sketch 

Without loss of generality, we assume that A is a nonnegative block-rank-1 matrix. To show that Z\(-) 
is either in P or #P-hard, we use the following two steps. 

In the first step, we define from A a finite sequence of pairs: 

(£o,2)o), (£1,2)1), . . . , (Xh,%)h)> for some h : < h< m, 

where Xo = {1}, 2)o = {A} and 1 denotes the m-dimensional all-1 vector. Each pair (3£&,2Jfc), k £ [h], is 
defined from (Xk-i, SJit-i). Roughly speaking, 2)^ (resp. is the set of all edge matrices (resp. vertex 
vectors) that may appear in Qj., after k rounds of domain reductions. There also exist positive integers 

m = too > toi > . . . > to/i > 1 

such that every k £ [h], is a set of m& x Tn^ non- negative matrices; and every Xk, k £ [h], is a set of 
TOfc-dimensional non-negative vectors. Although the sets and 2)& are infinite in general (which is the 
reason why we used the word "define" instead of "construct"), the definition of (3£fc,2Jfc) guarantees the 
following two properties: 
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1. For each k £ [h], all matrices in 2J& share the same structure: VB,B' £ %)k, B^j > 44> • > 0; 

2. Every matrix B in 2)^ is a permutation matrix. 

The definition of (Xfc,2Jfc) from (3Efc-i) 2)fc-i) can be found in Appendix [Cl In Appendix IPl we prove 
that for every k £ [h], if B £ 2J&, then the problem of computing Zs(-) is polynomial-time reducible to 
the computation of Z\(-). From this, we can obtain the hardness part of our dichotomy theorem: If for 
some k £ [h], there exists a matrix B £ 2)^ such that B is not block-rank-1, then Zj^(-) is #P-hard. 

Now we assume that all matrices in 2)^, k £ [h], are block-rank-1. To finish the proof we only need 
to show that if this is true, then Za(-) is indeed in P. To this end, we use the domain reduction process 
to construct a sequence of labeled directed graphs Gi,---,Gh such that 

1. Z(Gi) = Z A (G) and Z(Gk+l) = Z{G k ) for all k : 1 < k < h; and 

2. For every k £ [h], we have £ 2)^ for all edges e in Gk and £ 3L k for all vertices v in Gk- 

This sequence can be constructed in polynomial time, because the construction of Gk+i from Gk can be 
done very efficiently as described in Section 11.11 and also because the number of graphs in the sequence 
is at most m. By the two properties above, we have Zj^iG) = Z(Gh)', an d every edge weight matrix AW 
in Qh is a permutation matrix. As a result, we can compute ZpJ^G) in polynomial time since Z{Gh) can 
be computed efficiently. 

This finishes the proof of our dichotomy theorem: given any non-negative matrix A, the problem of 
computing Zj^(-) is either in polynomial time or #P-hard. Moreover, to decide which case it is, we only 
need to check whether the matrices in 2}^, k £ [h], satisfy the following condition: 

The Block- Rank-1 Condition: Every matrix B E 2}^, k € [h], is block-rank-1. 

However, as mentioned earlier, all the sets 2)fc> k £ [h], are infinite in general, so one cannot check the 
matrices one by one. Instead, we express the block-rank-1 condition as a finite collection of polynomial 
constraints over 2)^. The way (Xfc,2Jfc) is defined from (X k -i, %)k-i) allows us to prove that, to check 
whether every matrix in 2)^ (or every vector in X&) satisfies a certain polynomial constraint, one only 
needs to check a finitely many polynomial constraints for (X^-i, 2}fc_i). Therefore, to check whether 2)^, 
k £ [h], satisfies the block-rank-1 condition we only need to check a finitely many polynomial constraints 
for (j£o>2)o)- Since 3Lq = {1} and 2)o = {A} are both finite, this can be done in a finite number of steps. 



2 Preliminaries 

We say G = (G, V, £) is a labeled directed graph over [m] = {1, . . . , m} for some positive integer m, if 

1. G = (V, E) is a directed graph (which may have parallel edges but no self-loops); 

2. Every vertex v £ V is labeled with an m-dimensional non-negative vector V(v) £ as its 
vertex weight; and 

3. Every edge uv £ E is labeled with an m x m (not necessarily symmetric) non-negative matrix 
£(uv) £ M™ xm as its edge weight. 

Let G = {G, V, £) be a labeled directed graph, where G = (V, E). For each v £ V, we use w'"' = V(v) 
to denote its vertex weight vector; and for each uv £ E, we use = £{uv) to denote its edge weight 
matrix. Then we define Z(G) as follows: 

Z(G) = £ wt(0,0, where wt(g,£) = J] ^(i) II 
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denotes the weight of the assignment £. 

Let C be an m x m non-negative matrix. We are interested in the complexity of Zc(-)'- 

Z C (G) = Z(G), for any directed graph G = (V, E), 

where Q = (G, V, 8) is the labeled directed graph with V(v) = 1 € M.™ for all v G V and £{uv) = C for 
all edges uv G E. 

Definition 1 (Pattern and block pattern). We say V is an m x m pattern ifVQ [m] x [m\. V is said 
to be trivial i/P = 0. A non-negative m x m matrix C is of pattern V , if for all i,j G [m], we have Cij 
> if and only if (i,j) G P. C is also called a P-matrix. We say T is an m x m block pattern if 

1. T= {(A l ,B 1 ),...,(A r ,B r )} for some r > 0; 

2. Ai C [m], Ai / 0, Bi C [m] and Bi ^ /or aZZ i G [r]; anrf 
5. Ai n Aj = ^ n Bj = 0, /or all i^ j G [r] . 

T is said to 6e trivial if T = 0- ^4 block pattern T naturally defines a pattern V, where 

V = {(i,j) | 3 A; G [r] swc/i that i G ^4fe and j G 

Tl^e a/so say "P is consistent luif/i T. Finally, we say a non-negative mx m matrix C is o/ block pattern 
T , if C is of pattern V defined by T. C is a/so called a T-matrix. 

Definition 2. VFe say an m x m non-negative matrix C is block-rank-1 if 

1. Either C = is the zero matrix {and is of block pattern T = 0); or 

2. C is o/ block pattern T , for some mx m block pattern T = {(A\, B\), . . . , (A r , B r )} with r > 1; 
and for every k G [r], t/ie sub-matrix of C induced by Aj. and B^ is (exactly) rank 1. 

Le£ C be a non-negative block-rank-1 matrix of block pattern T . Then there exists a unique pair (a, 3) 
of non-negative m- dimensional vectors such that 

1. For every i G [m], ai > <==> i G Ufce[r] A ki and > <^> i G \Jke[r] B k>" 

2. Cij = cti ■ (3j for all i,j G [m] such that Cij > 0; and 

3 - Y,jeA l a i = l > f or al1 i e M- 
The pair {ex., 3) is called the (vector) representation of C. Note that we have a = 3 = when C = 0. 

It is clear that T and (ex., 3) together uniquely determine a non-negative block-rank-1 matrix. 
The following lemma concerns the complexity of Zq(-). The proof can be found in Appendix [Bj 

Lemma 1. If C is not block-rank-1, then Zq(-) is #P-hard. 

Let T be an m x m non-trivial block pattern where T = {(^4i, B\), . . . , (A r ,B r )} for some r > 1. It 
defines the following r x r pattern V = gen(T): For all i,j G [r], (i,j) G V if and only if Bi n -Aj 7^ 0. 
We also define gen-block(T) as follows: 

1. If V = gen(T) is consistent with a block pattern, denoted by T' , then gen-block(T) = T'; 

1. Otherwise, we set gen-block(T) = false. 

We note that V = gen(T) could be trivial even if T is non-trivial. 

Next, we introduce a generalized version of Zc(-). Let rn > 1 and (CP, 0) be a pair in which 
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1. is a finite and nonempty set of non- negative m-dimensional vectors with 1 £ *P; and 

2. Q is a finite and nonempty set ofmxm non- negative matrices. 
We then use Z(-) to define the function Z<^^(-) as follows: 

%q(S) = 

where £ = (G, V,f) is a labeled directed graph with V(v) € ^ for any vertex v € ^(G); and £(uv) £ 13 
for any edge € E(G). As an example, ^c(') is exactly -^qj,jQ (■) with *p = {1} and O. = {C}. 
Finally, let m > 1 and (X, 2)) and (X',2)') be two pairs such that: 

1. X and X' are two nonempty (and possibly infinite) sets of non- negative m-dimensional 
vectors with 1 6 X and 1 and 

2. 2} and 2J' are two nonempty (and possibly infinite) sets of non-negative m x m matrices. 

Definition 3 (Reduction). We say (X',2J') is polynomial-time reducible to (X, 2J) if for every finite and 
nonempty subset ty' C X' with 1 € ^3' and every finite and nonempty subset O 1 C 2J' ; there exist a finite 
and nonempty subset C X 1 € *p and a finite and nonempty subset C 2J, suc/i i/iai ^sp^Q^-) is 
polynomial-time reducible to Z^q(-). 

3 Main Theorems 

We prove a complexity dichotomy theorem for all counting problems Zq(-) where C is any non- negative 
matrix. Actually, our main theorem is more general. 

Definition 4. Let V be an m x m pattern. An m-dimensional non-negative vector w is said to be 

- positive: Wi > for all i £ [m]; and 

- P-weakly positive: for all i £ [m], Wi > if and only if (i,i) £ V . 
We call (X,2J) a P-pair if 

1. X is a nonempty (and possibly infinite) set of positive and V- weakly positive vectors with 1 £ X; 

2. 2) is a nonempty (and possibly infinite) set of m x m (non-negative) V -matrices. 

We say it is a finite V-pair if both sets are finite. We normally use (*p, Q) to denote a finite V-pair. 

Similarly, for any mx m block pattern T, we can define T-weakly positive vectors as well as T-pairs 
by replacing the V above with the pattern defined by T ■ 

We prove the following complexity dichotomy theorem: 

Theorem 2 (Complexity Dichotomy). Let V be an m x m pattern for some m > 1, then for any finite 
P-pair (^3, Q) ; the problem of computing Z^ q(-) is either in polynomial time or #P-hard. 

Clearly, it gives us a dichotomy for the special case of Zc(-) when *p = {1} and = {C}. Moreover, 
we show that for the special case when *p = {1}, we can decide in a finite number of steps whether Z^q 
is in polynomial time or ^P-hard. In particular, it implies that the dichotomy for Zc(-) is decidable. 

Theorem 3 (Decidability). Given any positive integer m > 1, an m x m pattern V, and a finite V-pair 
(*P,£2) with *p = {1}, the problem of whether Z^^(-) is in polynomial time or #P-hard is decidable. 

We prove Theorem [2] and [3] in the rest of the section. The lemmas (Lemma [H [3l and U]) used in the 
proof will be proved in the appendix. 
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3.1 Defining New Pairs: gen-pair (X, 2J) 

Before proving Theorem [2j we state a key lemma which will be proved in Appendix [C] and Appendix IF1 
Let (X, 2)) be a (possibly infinite) T-pair, for some non-trivial m x m block pattern T. Also assume 
that every matrix in 2} is block-rank-1. Then in Appendix [Cl we introduce an operation gen-pair over 
(X, 2)), which defines a new (and possibly infinite) pair (X',2)') = gen-pair (X, 2)). 

Definition 5. A set S of non-negative m- dimensional vectors, for some m > 1, is closed i/wi 0W2 G S 
for all vectors Wx,W2 G S 1 , where we let o denote the Hadamard product o/ too vectors: wi o W2 is i/te 
m-dimensional vector whose ith entry is w\,i ■ W2 t i for all i G [m]. 

In Appendix [Fj we prove the following lemma. 

Lemma 2. Let (X, 2)) 6e a T-pair, for some non-trivial block pattern T ■ Suppose every matrix in 2) is 
block-rank-1, then (X',2)') = gen-pair (X, 2)) is a V' -pair, where V' = gen(T). T7ie new vector set X' is 
closed and (X',2)') is polynomial-time reducible to (X, 2)). 

3.2 Proof of Theorem gj 

Let (*p, £}) be a finite "P-pair, where P is an m x m pattern. 

We assume ZmQ(-) is not #P-hard, and we only need to show that Zm ; Q{-) is in polynomial time. 

By Lemma [TJ there must be a block pattern T consistent with V and all the matrices in Q are block- 
rank-1 since otherwise Zm q(-) is #P-hard, which contradicts the assumption. Therefore, we have 

Ro: O) is a finite 7~-pair for some mxm block pattern T; and 
Every matrix in Q is block-rank-1. 

For convenience, we rename (*}},£!) to be (Xo,2)o) and rename m and T to be mo and To, respectively. 

Now we define a finite sequence of pairs using the gen-pair operation, starting with (Xo,2)o). 

First, if \Ai\ = \Bi\ = 1 for all i, i.e., every set Ai and Bi in 7o is a singleton, then the sequence has 
only one pair (Xo,2)o), and the definition of this sequence is complete. Note that this also includes the 
special case when To = and 2)o = {0}. 

Otherwise, in Step 1, we define a new "Pi-pair (Xi,2)i) using gen-pair: 

(Xi,2)i) = gen-pair (X ,2) ), where V\ = gen(7^). 

By LemmaE] (Xi, 2)i) is polynomial-time reducible to (Xo,2)o). This implies that V\ must be consistent 
with a block pattern, denoted by 71, and every matrix in 2)i is block-rank-1. (Otherwise, assume D G 2)i 
is not block-rank-1, then by Lemma[U Z^ 1i q 1 {-) is #P-hard, where = {1} and Qi = {D}. It follows 
from Lemma[2]that there exists a finite pair (*Po>£Jo) where ^ Xo and Qo C 2)o, such that Zrp ly Q 1 (-) 
is polynomial-time reducible to Z<$ 0t Q (-). On the other hand, it is clear that Z<$ ^ (-) is reducible to 
Zx 0i 2) (-) and thus, the latter is also #P-hard, which contradicts our assumption.) As a result, we have 

Rj: 71 = gen-block(7o) is an mi x m-i block pattern, where mi is the number of pairs in To; 
(Xi,2)i) = gen-pair(Xo, 2)o) is a 7i-pair, and every matrix in 2)i is block-rank-1. 

We also have mo > mi since at least one of the sets in 7o is not a singleton. 

We remark that both sets Xi and 2)i are generally infinite, so one can not check the matrices in 2)i 
for the block-rank-1 property one by one. It does not matter right now because we are only proving the 
dichotomy theorem. However, it will become a serious problem later when we show that the dichotomy 
is decidable. We have to show that the block-rank-1 property can be verified in a finite number of steps. 

We then repeat the process above. After t > 1 steps, we get a sequence of t + 1 pairs: 
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(£o,9o),(£i,2h),---,(^,?W, 
and £ + 1 block patterns To, 71, . . . , 7} such that 

R^: For every i G % = gen-block(7i-i); 

For every i G [£], = gen-pair(Xj_i, 2)i-i) is a 7^-pair; and 

For every i £ [0 : ■£], all the matrices in 2Jj are block-rank-1. 

We have two cases. If every set in T is a singleton (including the case when T = and 2J^ = {0}), then 
the sequence has only £ + 1 pairs and the definition of the sequence is complete. Otherwise in Step I + 1 
we apply the gen-pair operation again to define a new pair (X^+i, 2)^+i) from (££,2J^). 
Finally, assuming Zrp^-) is not #P-hard, we get a sequence of h + 1 pairs 

(£ , ?)o), • • • , (X h ,%) h ), for some > 0, 

together with h + 1 positive integers mo > . . . > > 1 and h + 1 block patterns To, ■ ■ ■ ,Th such that 

R: For every i G [0 : /i], 7i is an mj x m; block pattern; 
For every i £ [/i], 71 = gen-block(Ti-i); 
Either 7^ = is trivial or every set in 7^ is a singleton; 
For every i G [/i], (£j,2)i) = gen-pair(Xj_i, 2Jj_i) is a 7I-pair; and 
For every i € [0 : /i], all the matrices in 2Jj are block-rank-1. 

Because mo > . . . > m^ > 1, we also have h < mo = m. 
3.2.1 Dichotomy 

Now we know that if Zsp 5 £j(-) is not ^P-hard, then there is a sequence of h + 1 pairs for some h : < h 
< m, which satisfies condition (R). To complete the dichotomy theorem, we show in Appendix ID1 that 

Lemma 3 (Tractability). Given any block pattern T and a finite T-pair (*}3, £}), let (Xq, 2Jo), • • • , (jE/j, 
6e a sequence of pairs defined as above, with (3£o,?Jo) = (*p,£j). Suppose it satisfies condition (R), then 
computable in polynomial time. 

This finishes the proof of Theorem (2) 
3.3 Proof of Theorem |3] 

Next, we show that for the special case when Xq = *p = {1}, the dichotomy theorem is decidable. 
First, the condition (Ro) can be checked easily since there are only finitely many matrices in 2Jo- 
Assume after £ : < £ < m steps, we get a sequence of £ + 1 pairs: (Xo,2Jo), (Xi,2Ji), • • • , 
together with £ + 1 block patterns 7o, • • • Moreover, we know that they satisfy (R^). If every set in 
Ti is a singleton (including the case when T = 0), then we are done because by Lemma El the problem 
is in polynomial time. Otherwise, to prove Theorem El we need a finite-time algorithm to check whether 
every matrix in the new "P-pair (X^+i, 2J^ + i) = gen-pair(3^, 2J^), where V = gen(7i), is block-rank-1 or 
not. We refer to this property as the rank property for %)e+i- 

We prove the following lemma in Appendix [Gj Theorem [3] then follows. 

Lemma 4. Given any block pattern T and a finite T-pair (Xo,2Jo) with = {\} , let (Xo, 2Jo), • • • , (3^, 2J^) 
be a sequence of pairs defined as above. Suppose it satisfies condition (R^). Then the rank property for 
can be checked in a finite number of steps. 
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Figure 2: The 8x8 block-rank- 1 matrix A 




Figure 3: The input directed graph G 
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B Proof of Lemma [T] 



Bulatov and Grohe showed that for any m x m non-negative symmetric matrix D, ^d(-) is #P-hard if 
D is not block-rank-1. Note that when D is symmetric, the directions of the edges in G do not affect the 
value of Zd(G), so we can always assume that G is an undirected graph. 
We prove Lemma [T] by giving a reduction from the symmetric case. 

Let C be an m x m non- negative matrix, which is not block-rank-1. Without loss of generality, we 
may assume that Ci, C2, the first and the second row vectors of C, satisfy Ci • C2 > 0; but Ci and C2 
are not linearly dependent. Let D denote the following symmetric matrix: 

Dij = Ci ■ Cj, for all i,j € [to]. 

By the assumption, we have D%\, D\ 2, D2 1, D2 2 > but D11D22 > f 12-^2 l- It then follows from the 
result of Bulatov and Grohe that Zj^(-) is #P-hard to compute. 

Now we prove the #P-hardness of Zq(-) by showing a reduction from Z-£>(-). Let G = (V,E) be an 
input undirected graph of Zj^(-). We construct a directed graph G' = (V',E') in which 

V' = V U {w e : e £ E} and E' = { uw e , vw e : e = uv € E } . 

By the definition of Zc(-) and Zj)(-), it is easy to verify that 

Zc(G') = Zj}(G), for any undirected graph G. 

As a result, ^d(') is polynomial-time reducible to Zq{-), and the latter is also #P-hard. 

C Definition of the gen-pair Operation 

In this section, we define the operation gen-pair. 

Let T = {(Ax, Bi), ... , (A r ,B r )} be a non-trivial m x m block pattern with r > 1. We use diag(T) 
to denote the set of all i G [m] such that i E and i G -B^ for some /c € [r]. In this section, we always 
assume that (X, 2)) is a T-pair such that every matrix in 2) is block-rank-1. This means that 

1. All matrices in 2) are block-rank-1 and are of the same block pattern T; 

2. 1 6l and every vector w 6 X is either 

positive: W{ > for all i £ [m]; or 

T -weakly positive: wi > if and only if i G diag(T). 

Given such a pair (3t, 2J), gen-pair defines a new "P-pair 

(X', 2)') = gen-pair (X, 2J), where V = gen(T). 

To this end we first define a pair (3£*,2J*) from 2J), which is a generalized V-pair defined as follows. 

Definition 6. Let V be an r x r pattern with r > 1. An r x r nonnegative matrix is called a "P-diagonal 
matrix if it is a diagonal matrix and for all % 6 [r], its (i, eniry is positive if and only if (i, i) € "P. 
W^e call (X*,2J*) a generalized P-pair if 

1. X* is a nonempty (and possibly infinite) set of positive and P-weakly positive vectors with 1 € I*; 

2. 2}* is a nonempty (and possibly infinite) set of V '-matrices and P-diagonal matrices. 

For any block pattern T , one can define T-diagonal matrices and generalized T-pairs similarly, by rep- 
lacing the pattern V above with the one defined by T ■ 
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We then use (X*,2J*) to define (X',2J'). In this section we only show that (X',2)') is a P-pair and X' 
is closed. We will give the polynomial-time reduction from (X',2)') to (X, 2)) in Appendix H3 

C.l Definition of 2J* 

We define 2J* which contains both P- matrices and "P-diagonal matrices, where V = gen(T). 
There are two types of matrices in 2J*. First, D is an r x r V- matrix in 2)* if there exist 

1. a finite subset of matrices {CM, . . . , C^} C 2) with g > 1, and positive integers s±, . . . , s g ; 

2. a finite subset of matrices {D^ , . . . , D^} C 2) with h > 1, and positive integers t\, . . . , th', 

3. a positive vector w G X, 

such that: Let (aW,/3™) and (7^,<5^) be the representations of CM and DW, respectively, then 

A,i= E (^ ] ) S1 "--(^ ] ) Sa -(^ 1 ) tl -(^ ] ) t ' 1 -^ foralH,iG M . 
The following lemma is easy to prove. 

Lemma 5. If w € X is positive, then the matrix D defined above is a P-matrix, where V = gen(T). 

Proof. Because (X, 2J) is a T-pair, all the matrices and D^, i E [g] and j E [/i], are T-matrices and 
thus, (3® is positive over Bi U • • • U fi r and 7^ is positive over U • • • U A r . Since w is positive, it is 
easy to check that Dij > if and only if Bi n Aj ^ 0. □ 

Second, D is an r x r P-diagonal matrix in 2J* if there exist 

1. a finite subset of matrices {CW, . . . , C^} C 2) with g > 1, and positive integers s\, . . . ,s g ; 

2. a finite subset of matrices {DM, . . . , D^} C 2J with h > 1, and positive integers t\, . . . , t^; 

3. a 7" -weakly positive vector w € X, 

such that: Let (a^,f3^) and (7^,(5^) be the representation of and D^, respectively, then 

E (4 1] ) S1 ---(4 9] ) S9 -(^) tl ---(^) th -^ foralH,iE[r]. 
Similarly one can show that 

Lemma 6. Ifw is T -weakly positive, then the matrix D defined above is "P-diagonal where V = gen(T). 

Proof. First, we show that D is diagonal. Let i ^ j be two distinct indices in [r]. If Bi n Aj = 0, then 
Di j is trivially 0. Otherwise, for every k 6 B^nAj, we know that (k, k) is not in the pattern defined by T 
because k & Bi, k € Aj but i ^ j. As a result, we have = which implies Djj = for all i ^ j £ [r]. 

Second, if Ai n -Bj 7^ then fc) is in the pattern defined by T for every k € fl -Bj. This implies 
that > 0. As a result, we have D^i > if and only if Ai n Bi ^ 0. □ 
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C.2 Definition of X* 

Now we define X*. To this end, we first define X* which is a set of r-dimensional positive and T- weakly 
positive vectors. We have w# G X# if and only if one of the following four cases is true: 

1. w # = 1; 

2. There exist a finite subset {CM, . . . , C^} C 2) with g > 1, positive integers si, . . . , s 9 and a vector 
w£l (positive or T-weakly positive) such that: Let (a^ l \(3^) be the representation of C^, then 

w f = ^ (4 1] ) Sl • • • (4 9] ) S9 • u>x, for all i G [r]. 

It can be checked that w# is positive if w is positive and w# is T-weakly positive if w is T-weakly 
positive. 

3. There exist a finite subset {D^, . . . , D^} C 2) with h > 1, positive integers t±, . . . ,t g and a vector 
w G X (positive or T-weakly positive) such that: Let (7W, 5^) be the representation of DW, then 

-f =E(4 1] ) tl ---(^ 1 ) <h --- foralHGH. 

Similarly, it can be checked that w# is positive if w is positive and w# is T-weakly positive if w is 
T-weakly positive. 

4. There exist two finite subsets {C^, . . . , C^} C 2J and {DW, . . . , D^} C 2J with g > 1 and h > 1, 
positive integers si, . . . , s g , ti, . . . , th and a vector w G X (positive or T-weakly positive) such that: 
Let (aW,/3^) and (7^,5^) be the representations of and DW, respectively, then 

-f = E (4 1] ) S1 • • • (& w )" • 0*T • • • W • w - for a11 * G [r] - 

It can be checked that w* is always a T-weakly positive vector. 

This finishes the definition of X*. 

Set X* is the closure of X#: w G X* if and only if there exist a finite subset {wi, . . . , w ff } C X# and 
positive integers s±, . . . , s g such that 

w = (wi) Sl o • • • o (wg) S3 , 

where o denotes the Hadamard product. It immediately implies that X* is closed, and any vector in it is 
either positive or T-weakly positive. It is also easy to check that (X*,2)*) is a generalized T-pair. 

C.3 Definition of (X', 2)') 

We use (X*,2)*) to define (X',2J') as follows. 

First, 2)' contains exactly all the T-matrices in 2J*. 

The definition of X' is more complicated. We have w' G X' if and only if 

1. w' G X*; or 

2. There exist 
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(a) a finite subset of 'P-matrices {C^, . . . , C^} C 2J* with g > (so this set could 
be empty) and g positive integers s\, . . . ,s g ; 

(b) a finite subset of "P-diagonal matrices {D^, . . . ,D^1} C 2J* with h > 1, and h 
positive integers t\,... ,th', 

(c) and a vector w £ X* (which is either positive or V- weakly positive), 
such that w' satisfies 

«<-«.• (clT)' 1 ■ ■ ■ (eg)" • (»!:])" ■ ■ ■ («Sf • *» m ' * M- 

It can be checked that every w' £ X' is either positive or "P-weakly positive. 

This finishes the definition of (X',2J') and the gen-pair operation. It is easy to verify that the new 
pair (X',2)') is a "P-pair. Moreover, since X* is closed, one can show that X' is also closed. This proved 
the first part of Lemma [2j 

Lemma 7. Let (X, 2J) be a T -pair for some non-trivial block pattern T ■ Suppose every matrix in 2J is 
block-rank-1 , then (X',2)') = gen-pair(X, 2J) is aV-pair, where V = gen(T), and X' is closed. Moreover, 
the pair (X*,2J*) defined from (X, 2J) is a generalized V-pair and X* is also closed. 

D Dichotomy: Tractability 

In this section, we prove Lemma [31 the tractability part of the dichotomy theorem. 

Let (Xo,2Jo) = 0P>£2) be a finite 7o-pair, for some block pattern To- Let (Xo,2Jo), • • • , (Xh,%)h) be a 
sequence of h + 1 pairs for some h > 0, tuq > mi > . . . > m^ > 1 be h + 1 positive integers, and To, 
71 , . . • , Th be h + 1 block patterns such that 

R: For every i£ [0 : h], Ti is an raj x mi block pattern; 
For every i S [h], % = gen-block(7i-i); 
Either Th = is trivial or every set in Th is a singleton; 
For every i £ [h], (Xj,2)j) = gen-pair(Xj_i, 2Jj_i) is a 7i-pair; and 
For every i € [0 : h], all the matrices in 2Jj are block-rank-1. 

We need to show that Z<$^q{-) = Zx Q ^ Q {-) can be computed in polynomial time. 

Let Go = (Go,Vo,£o) be an input labeled directed graph of ^ ,2)o(')- By definition we have Vo(v) G 
Xo for all vertices v £ V(Go), and £o(uv) £ 2Jo for all edges uv £ E(Go)- We further assume that the 
underlying undirected graph of Go is connected. (If Go is not connected, then we only need to compute 
■^x ,?)o(') f° r eacn undirected connected component of Go and multiply them to obtain Zx 0> <g (Go)-) 

To compute Zx Q! <xj (Go), we will construct in polynomial-time a sequence of h + 1 labeled directed 
graphs Go, ■ ■ ■ , Gh- We will show that these graphs have the following two properties: 

Pi: For every £ £ [0 : h], Gi = (Gi,Vt,£e) is a labeled directed graph such that Vi(v) £ Xi for all v £ 
V(Gi); £e(uv) £ 2)^ for all uv £ E{G(); and the underlying undirected graph of Gi is connected. 

P 2 : Z(Go) = Z(Gi) = ■■■ = Z(G h ). 

As a result, to compute Z(Go), one only needs to compute Z{Gh)- On the other hand, we do know how 
to compute Z{Gh) i n polynomial time. If Th is trivial, then computing Z(Gh) is also trivial. Otherwise, 
if every set in Th is a singleton, then one can efficiently enumerate all possible assignments of Gh with 
non-zero weight (since the underlying undirected graph of Gh is connected). This allows us to compute 
Z(Go) = Z(Gh) in polynomial time. 
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D.l Construction of Q' from Q 

Let (X, 2)) be a T-pair for some m x m non-trivial block pattern T such that all the matrices in 2J are 
block-rank-1. Then by LemmaEl (X',2)') = gen-pair(X, 2J) is a P-pair where V = gen(T). 

Let Q = (G,V,£) be a labeled directed graph such that V(v) G X for all t> G V"(G); £(uv) G 2J for 
all G E(G); and the underlying undirected graph of G is connected. We further assume that G is not 
trivial: V is not a singleton (since for this special case, Z{Q) can be computed trivially). In this section, 
we show how to construct a new graph Q' = (G' ,V ,£') in polynomial time such that V'(v) G X' for all 
v G V(G'); £'{uv) G 2)' for all uu G E(G'); the underlying undirected graph of G" is connected; and 

Z(Q) = Z(G'). (2) 

Then we can repeatedly apply this construction, starting from Qq, to obtain a sequence of h + 1 labeled 
directed graphs C?o> ■■■ iQh that satisfy both Pi and P2. Lemma[3]then follows. 

Now we describe the construction of Q' . Let G = (V, E) and T = {(A\,Bi), . . . , (A n , B n )} for some 
n > 1, then V = gen(T) is an n x n pattern. The construction of Q' is divided into two steps, just like the 
definition of (X',2)') = gen-pair (X, 2J) in Appendix [Cl In the first step, we construct a labeled graph 
g* = (G*,V*,£*) from £ such that 

1. V*(v) G X* for all v G V(G*)\ £*{uv) G 2J* for all uv G E(G*); and the underlying undirected 
graph of G* is connected, where (X*,2J*) denotes the generalized "P-pair defined in Appendix O 

2. z{g*) = z{g). 

In the second step, we construct g' from g* and show that Z(Q') = Z(g*). 
D.l.l Construction of Q* from g 

Let g = (G,V,£) and G = (V,E). We decompose the edge set using the following equivalence relation: 
Definition 7. Let e, e' be two directed edges in E. We say e ~ e' if there exist a sequence of edges 

e = e ,ei, . . . ,e k = e' 

in E such that for all i G [0 : k — 1], &i and e^\ share either the same head or the same tail. 

We divide E into equivalence classes R\, . . . , Rf using ~: 

E = R x U . . . URf, for some / > 1. 

Because the underlying undirected graph of G is connected, there is no isolated vertex v in G and thus 
every vertex v G V appears as an incident vertex of some edge in at least one of the equivalence classes. 
This equivalence relation is useful because of the following observation. 

Observation 1. For any i € [/], the subgraph spanned by Ri is connected if we view it as an undirect- 
ed graph. There are three types of vertices in it: 

1. Type-L: vertices which only have outgoing edges in R^; 

2. Type-R: vertices which only have incoming edges in Rf, and 

3. Type-M: vertices which have both incoming and outgoing edges in Ri. 
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Let £ : V — > [m] be any assignment with wt(Q, £) 7^ 0, then for any i G [/] there exists a unique ki G [n] 
such that the value of every edge «t> 6 i?j is derived from the /cj-th block of T: 

G and G B*.. 

Therefore, for every % G [/], there exists a unique fej G [n] such that 

1. For every Type-L vertex v in the graph spanned by Ri, £(v) G A^; 

2. For every Type-R vertex v in the graph spanned by R4, £(v) G B^.; and 

3. For every Type-M vertex v in the graph spanned by R4, £(v) G A^ PI -B^. 

Now we build = (G*,V*,S*), where G* = (V*,.E*). We start with the construction of G*. V* is 
exactly [/] in which the vertex i G [/] corresponds to Ri of G. For every vertex v G V, if it appears in 
both the subgraph spanned by i?j and the one spanned by Rj for some i 7^ j G [/] (note that it cannot 
appear in more than two such subgraphs) and if the incoming edges of v are from Ri and the outgoing 
edges of v are from Rj, then we add a directed edge ij in E*. Note that E* may have parallel edges. 
This finishes the construction of G*. It is easy to verify that the underlying undirected graph of G* is 
also connected. 

The only thing left is to label the graph G* with vertex and edge weights. For every edge in E* we 
assign it the following n x n matrix D. Assume the edge ij is created because of v G V, which appears 
in both Ri and Rj. Let the incoming edges of v be u±v, . . . ,u s v in Ri and the outgoing edges of v be 
vwi, . . . , vwt in Rj, where s, t > 1. We use G 2) to denote the edge weight of UiV, DW G 2) to denote 
the edge weight of t>u>j, and w G X to denote the vertex weight of v in Q. We also use (a^,^) and 
(7^,5^) to denote the representations of and D^, respectively. Then the [i, j)th entry of D is 

Di,j= E ^■■■4 SL 7^---7| 1 -^, foralH,jG[n]. 

By the definition of gen-pair, it is easy to check that D G 2J*. 

Finally, we define the vertex weight of i G [/]. To this end, we first define an n-dimensional vector 
w'"] for each vertex v G V that only appears in Ri. We then multiply (using Hadamard product) all such 
vectors to get the vertex weight vector of i £ [/]. 

Let v £ V he a vertex which only appears in R4, then we have the following three cases: 

1. If v is Type-L, then we use vu>\, . . . , vw s to denote its outgoing edges. We let w denote the vertex 
weight of v in Q and denote the edge weight of vwj with representation (cx^,(3^). Then 

W W = ^ 4 11 • • • 4" ] • w x , for all ke[n}. 

xeA k 

2. If v is Type-R, then we use u\v, . . . , u s v to denote its incoming edges. We let w denote the vertex 
weight of v in Q and denote the edge weight of UjV with representation Then 

w k ] = E ^■■■A s] -w x , for all ke[n\. 

xeB k 

3. If f is Type-M, then we use u±v, . . . , u s v, vw\, . . . , vwt to denote its edges where s,t > 1. We let w 
be the vertex weight of v in C^l be the edge weight of UjV with representation and 
D^l be the edge weight of with representation (7^, 5^). Then 

™f = E ^■■■^ I -7^ ] -7^ ] -«'*, foraUfc€[n]. 

xe-B fe nA fe 
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We then multiply (using Hadamard product) all the vectors over all vertices v that only appear in 
Ri to get the vertex weight vector w of i G [/] in Q* . By definition, it can be checked that w G X*. This 
finishes the construction of Q* . Next, we show that Z{Q*) = Z{Q). 
Let eft : V* = [f] — > [n] be any assignment. We use to denote 

: V -»• [m] Vi G [/], V™ G £(u) G and G 

Equivalently, defines for each vertex v G V a set f7„ C [m], where 

1. If f appears in both the subgraph spanned by Ri and the subgraph spanned by Rj, for some 
i 7^ j G [/]; and u is Type-R in .R, and Type-L in then U v = B^ n A/>(j); 

2. Otherwise, assume v only appears in the subgraph spanned by Ri. Then 

(a) If v is Type-L, then U v = A^y, 

(b) If v is Type-R, then U v = B </>(%)', and 

(c) If v is Type-M, then U v = B^ n A^y 

such that £ G G for all t> G V. In particular, = if J7 V = for some t> G V. 

By Observation [H if wt(C?,£) ^ then £ G 3^ for some unique (ft. For any w G V, we let w'"' denote 
its vertex weight in Q; and for any uv G E, we let denote its edge weight in Q, with representation 

(aH i( gH), Then by the definition of H , we have for all £ G E^, 

^V),^) = a^J) • %j , for all uv G £. 
Therefore, we have the following equation: 

£wt (s ,f)= Wn«s, n4<:','«)- 

§es ^eH^ V>eV uues / 



This sum can be written product: 



2 wt@,0= 



in which for every i> G V, the factor if„ is a sum over G U v . 
By the construction of Q*, we can show that 

wt(g*,0) = ^ wt(g,o = J] (3) 

This follows from the following observations: 

1. If v appears in both the subgraph spanned by Ri and the subgraph spanned by Rj, for some 

i 7^ j G [n], and this v defines an edge ij G E* , then the edge weight of this edge ij in Q* with 
respect to (ft is exactly H v ; 

2. For every i G [n], we let C V denote the set of vertices that only appear in the subgraph 
spanned by Ri. We also let w denote the vertex weight of i G [n] in Q* . Then we have 

W£(i) = IJ H v . 
vevt 
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As a result, it follows from ([3]) that 

<t> <j> £es 

D.1.2 Construction of Q' from 

Let Q* = (G* ,V* , £*) be the labeled directed graph constructed above, where G* = (V*,E*). We know 
that V*(v) G X* for all v G V*; £*{uv) G 2)* for all uv £ E*; and the underlying undirected graph of G* 
is connected. Since (3t*,2)*) is a generalized P-pair, every D G 2J* is either a P-matrix or a P-diagonal 
matrix. 

We will build a new labeled directed graph Q' = (G',V',£ f ) with G' = (V', E') such that V'(v) G £' 
for all v G V; £'{uv) G 2)' for all uv G £?'; the underlying undirected graph of G' is connected; and 

z(g') = z(g*). 

Let E* = Eq U Ei , where Eq consists of the edges in E* whose weight is a P-matrix and E\ consists 
of the edges in E* whose weight is a P-diagonal matrix. We decompose the vertex set V* of G* using 
the following equivalence relation ~. 

Definition 8. Let v,v' be two distinct vertices in V* . v ~ v' if v and v' are connected by E\ (which is 
viewed as a set of undirected edges here). 

By using ~, we divide V* into equivalence classes V±, . . . , V g for some g > 1. This relation is useful 
because of the following observation: 

Observation 2. Let (j) : V* — > [n] be an assignment with non-zero weight: wt(G*,(j)) ^ 0. Then for any 
i G [g], there exists a unique ki G [n] such that (ft(v) = ki for all v G V{. 

Now we construct Q' = (G", V', £'). First we construct G' = (V' , E'). V' is exactly [g] in which vertex 
i G [g] corresponds to Vi. For every edge uv G Eq such that u £ Vi, v £ Vj, and i / j £ [j], we add 
an edge from i to j in G'. This finishes the construction of G' . It is easy to verify that the underlying 
undirected graph of G' is also connected. 

Finally, we assign vertex and edge weights. For each edge ij in G' , suppose it is created because of 
uv G Eq. Then the edge weight of ij is the same as that of uv. As a result, all the edge weight matrices 
of Q' come from 2J' (since by definition of gen-pair, 2J' contains all the 'P-matrices in 2J*)- 

We define the vertex weights of Q' as follows. If Vi = {v} is a singleton, then the vertex weight of i 
in Q' is the same as the weight of v in Q* . Otherwise, we let v\, . . . ,v r be the vertices in Vi with r > 1, 
let e\, . . . , e s be the edges in Ex with both vertices in Vi for some s > 1, and let e[, . . . , e' t be the edges 
in Eq with both vertices in Vi for some t > 0. We use G X* to denote the vertex weight of Vj in Q' 
g 2J* to denote the "P-diagonal matrix of ej and G 2J* to denote the P-matrix of e'y Then we 
assign the following vertex weight vector w to i G V: 

Wk = w m . . . w w . c m . . . c w . D m . . . D ^ for every k e H 

By definition, we have w G 2)'. Using Observation [21 it is also easy to verify that Z(Q') = Z(Q*). 
This completes the proof of Lemma El 
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E Reduction: Normalized Matrices are Free to Use 

To give a polynomial-time reduction from (X',2)') = gen-pair (X, 2)) to (X, 2)), we need to first prove a 
technical lemma on normalized block-rank- 1 matrices. 

Let C be an m x m block-rank-1 matrix of block pattern T and representation (a,/3), where T = 
{(Ai,Bi), . . . , (A r , B r )} for some r > 1. By definition, a satisfies 

y~] Qj = 1, for all i £ [r]. 

We say C is the normalized version of C if it is an m x m block-rank-1 matrix of block pattern T and 
representation (o:,<5), where 



5j = ^ , for all j G Bi and i G [r] , 

so that d also satisfies 



<5j = 1, for all i G [r]. 

Let £2) be a finite T-pair for some non-trivial m x m block pattern T, and 

£2 = {CW...,CM}, 

in which every is block-rank-1 and has representation (a^,(3^). For each i £ [s], we let denote 
the normalized version of C^l with representation and 

0' = {d 1 ],...,cW,D[ 1 ],...,DW}. 

In this section, we prove the following technical lemma: 

Lemma 8. Z^q(-) and Z^ q'(-) are computationally equivalent. 

Proof. In the proof, we use two levels of interpolations and Vandermonde systems. 

We start with some notation. Let Q = (G,V,£) be the input labeled directed graph of Z<p Q/(-) with 
G = (V, E). For v G V, we use w' 11 ' <G ^3 to denote its vertex weight. We use Ei C E, i G [s], to denote 
the set of edges labeled with C^, and Fi C E, i G [s], to denote the set of edges labeled with DW. For 
every assignment £ : V — > [m], we define 

vw«) = n -si)' ^) = n n ^«,^,. <mo = n n 

dgV ig[s] uveEi ie[s] uveFi 

Note that a product over an empty set is equal to 1. 
Then we need to compute the following sum 

For all a G [s] and b G [r], we use /f| a ' > to denote the number such that 

eg = • £>jj , for all % G A and j G B^. 
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Actually, this gives us the following equation 

C-g = K[ a] • £>g , for all i G A b and j G [m], 

since Cl a l and have the same block pattern T. Then we use kw(£), where £ : V — > [m], to denote 

wo = n ( n 

ag[s] with £(u)eA b 

We use X to denote the set of all possible values of kw(£): 

X = (kw(£) \t:V^[m]}. 

It can be checked that \X\ is polynomial in \E\ since both s and r are considered as constants here. We 
use L to denote |X|. 

For aU k G [0 : L- 1], we build a new graph £ [fc] = (G^, V^, fW), where = (V^^M): 

1. V C and every t> G is labeled with the same vertex weight as in Q\ 

2. For all i G [s] and ut> G Ei, we add one edge uv G and label it with the same matrix C^; 

3. For all i G [s] and all e = uv G i^, we add L — k parallel edges from u to v with as their edge 
weights; we also add 2k new vertices u e j and v e j, j G [fc], to V^l; we add one edge from u to u ej - 
and one edge from v e j to v for all j G [k], all of which are labeled with C^. For each new vertex, 
we assign 1 as its vertex weight. 

It is clear that can be constructed in polynomial time and is a valid input of Zm 

Fix k G [0 : L — 1]. For every assignment <p : V — >• [m], we let denote the set of all £ : 
such that = for all v G V. We also define 

w#l(0)= ^ wt(e [fe U)- 

Then we have the following equation 



m\ 



J:VW->[m] tj>iV-+[m] 

By the construction, we show that 

w# ] (0) = vw(0) • cw(<£) • (dw(0)) L • (kw(0)) L+fc , for all Jfe G [0 : L - 1]. (4) 

First, we have 

wtw w =vw W .cw W . Wn( n ( c S. ww ) l "(n4U»., J )4L),«.,)))- o» 

CG= \ie[s] \e=wei^ / / / 

For each edge e = uv £ Fi for some i G [s], there must exist an index b e G [r] such that (f)(u) G ^4fe e and 
4>{v) G -Bf, e ; otherwise both sides of ([4]) are and we are done. In this case, the sum in ([5]) becomes 
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n ( n « ■ 4l« w f ' f e ^ J f e i ■ 

By the definition of (aW,j3^) and (aM,<$M), we have 

V = ag , V /f = ag , • irf 1 and V C M ,, , = v 

As a result, flBJ) becomes 

n( n (e^.,r«^)W) = n( n KHHW 1 

This finishes the proof of equation (UJ). 

Since L is polynomial in the input size, we can use Z^^q{-) as an oracle to compute 

vw(0) • cw(^) • (dw(0)) L • (kw(cP)y +k , for all fc G [0 : L - 1]. 

4>iV-t[m] 

in a polynomial number of steps. 

For every x € X, we use ^ to denote the set of <f) : V — > [m] with kw(0) = x, then we computed 



( vw( ^ ' cw( ^) ' ( dw (^)) I " x 



L+k , for all k € [0 : L - 1]. 

Because x > for all i 6 I, we can solve this Vandermonde system and obtain 

vw(^) • cw(0) • ^dw(</>)^ , for each ifl, 

in a polynomial number of steps. 

It is also clear that the whole process can be repeated for any L' > L with 

L < L + poly(input size), 

and we can use £<£,£}(•) as an oracle to compute 

vw(0) • cw(</>) • ^dw(0)^ , for all x € X and L < ll < L + poly(input size), 

in a polynomial number of steps. 

Next we use Y to denote the set of all possible values of dw(4>), <fi '■ V — I [m] (note it is possible that 
€ Y). Again, |E| is polynomial and we use M to denote \Y\. For every x G X, we can compute 

^2 vw(0) • cw(0) • (dw(0)) L+fc , for all A; € [0 : M - 1]. 
Let $2,^ denote the set of (j) with kw(0) = x and dw(</>) = y. Solving this Vandermonde system, we get 
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vw(^>) • cw ((/)), for all x G X and < y G y. 
Finally, using all these items, we can compute Zm Qi{G) in a polynomial number of steps: 

This proves the lemma since the other direction from Zt$^{-) to is trivial. □ 



F Polynomial-Time Reduction from (X',2)') to (36, 2)) 

Let (X, 2)) be a T-pair, where T is a non-trivial m x m block pattern 7" = {(-Ai, B\), . . . , (^4 r , -B r )} with 
r > 1 and every matrix in 2J is block-rank-1. Let V be the r x r pattern where V = gen(T) and (X', 2)') 
be the "P-pair generated from (X, 2J) using the gen-pair operation: (X',2)') = gen-pair (X, 2) ). We also 
use (X*,2J*) to denote the generalized P-pair defined in Appendix O 

In this section, we prove that (X',2)') is polynomial-time reducible to (X, 2J). To this end, we first 
reduce (X',2)') to (X*,2)*), and then reduce (X*,2)*) to (X, 2J). The first step is trivial, so we will only 
give a polynomial-time reduction from (X*,2J*) to (X, 2J) below. 

Let = {pH : i G [s]} be a finite subset of vectors in X* with 1 G and £}* = {FW : i G [t]} be a 
finite subset of matrices in 2J*. By the definition of gen-pair, they can be generated by a finite subset 
*P = {wW : i g [/i]} C X with 1 G and a finite subset £} = {CW ; i g [g]} C 2) in the following sense. 
(We let (o;W,/3W) denote the representation of for every i G [g].) 

For every matrix F G £3*, there exists a (2g + l)-tuple 

(A ; G[/ i ];k=(fe 1 ,...,A; g )^ = (4,...,^)), 
where ki,£i > 0, k ^ and £ ^ 0, such that 

e (^o fcl ---(^T 9 -K 1 4 ---K 9 0' 9 -^ ] - (7) 

This (2(7 + l)-tuple is also call the (not necessarily unique) representation of F with respect to (^3,£J). 

For every p G there exist three finite (and possibly empty) sets Si, S2 and £3 of tuples, where 
every tuple in S\ and £2 is of the form 

(k€[h]]1c=(k 1 ,...,k g )) 
with ki > and k / 0, and every tuple in £3 is of the form 

(ke[h);-k=(k 1 ,...,k g );£=(£ 1 ,...,£ g )) 
with ki, £% > 0, k 7^ and £ ^ 0. Every tuple in S\ gives us a vector whose ith entry, i G [r], is equal to 

E(4 1] ) fel -(4 9l ) fcs -4 fe] ; 
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every tuple in 1S2 gives us a vector whose ith entry, i 6 [r], is equal to 

and every (2g + l)-tuple in S3 gives us a vector whose ith entry, i G [r], is equal to 

E (4 1] ) fcl • • • (^ ] ) fc9 • • • • • ^ fc] - 

xeBiCiAi 

Vector p is then the Hadamard product of all these vectors. 

We remark that all the exponents ki,£i in the equations above are considered as constants, because 
both 0) and (^3*,£5*) are fixed. We now prove the following lemma. 

Lemma 9. Zsn* is polynomial-time reducible to Z<p i £j(-). 
F.l Proof Sketch 

We first give a proof sketch. Again, we will use interpolations and Vandermonde systems. 
First, by Lemma[8l we only need to give a reduction from ,£}*(•) to <«(•), where 

JK= {cW,DM : i e [<?]} 

contains both and its normalized version D^, i G [5]. 

Let Q = (G,V,£) be an input labeled graph of Z«p* ,£*(•)) where G = (V, E). For every assignment 
£ : V — > [r], we will define nvw(£) > 0. Moreover, let X be the set of all possible values of nvw(£), and 
L = \X\, then L is polynomially bounded. For every k G [L], we will build a new labeled directed graph 
gi k \ from £/. is a valid input graph of Zm f^(-) (with domain [m]) and satisfies 

%m(S [fc] )= E wt(^,£)-(nvw(e)) fc . (8) 

SV-Kr] 

For each 1 £ X, we use to denote the set of all £ : V — > [r] with nvw(£) = x. Then by solving the 
Vandermonde system which consists of equations ([8]) for A; = 1, 2, . . . , L, we can compute 

wt((/,£), for every x £ X, 
which allow us to compute in polynomial time 

z w MG)= E ^,6 = E E^) • 

F.2 Construction of <?M 

We start with the construction of (?M = (G^, VW,£W). It will become clear that the construction can 
be generalized to get for every k G [L]. 

Let V = [n], then the vertex set V"M of G^ = (V"W,£W) will be defined as a union: 

V [1] = Ri U i? 2 U • • • U Rn, 
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where Rk corresponds to vertex k G V and any edge uv G E^ will be between two vertices u, v G 
such that u,v £ Rk for some unique A; G [n]. i?j and Rj, i ^ j G [n], are not necessarily disjoint and there 
could be vertices shared by (at most) two different sets R4 and We further divide the vertices of Ri, 
i €. [n], into three types: In the subgraph of spanned by Ri, 

1. The Type-L vertices only have outgoing edges; 

2. The Type-R vertices only have incoming edges; and 

3. The Type-M vertices have both incoming and outgoing edges. 

When adding a new vertex, we will also specify which type it is. The construction also guarantees that 
the underlying undirected graph spanned by every Ri is connected. 

F.2.1 Construction of = (V"W,£?W) 
We start with the vertex set V' 1 '. 

1. First, for every i G [n] and a G [g], we add a new Type-L vertex itj jQ in Ri and add a new Type-R 
vertex Wi a in Ri. All these vertices appear in Ri only. 

2. Second, for every e = ij £ E, where i,j G [n], we add a vertex f e G Ri H which is a Type-R 
vertex in i?j and a Type-L vertex in Rj. 

3. Finally, for every i G V let p G *P* be its vertex weight in £?. Then by the discussion earlier, it can 
be generated from (*p, 0) using three finite sets of tuples <Si,c>2 and 53. For each tuple s in Si we 
add a new Type-L vertex Vi jS in i?,; for each tuple s in S2, we add a new Type-R vertex in Ri] and 
for each tuple s in S3 we add a new Type-M vertex in R4. All these vertices appear in R4 only. 

We will add some more vertices later. Now we start to create edges, and assign edge/vertex weights. 
First, for every i G [n], we add 2g edges to connect itj jQ and Wi >a , a G [5]: 

1. For every a G [3], add one edge from Uj j0 to itfj j0 , and label the edge with CW; 

2. For every a G [5], add one edge from Uj i(l to itfj +i (with = tOj 1), and label it with C' 1 '; 

3. For every a G [g], the vertex weight vector of both u ij0 and tOj ja is the all-one vector 1. 

Second, for each edge e = ij G -E, we add the incident edges of v e G i?i fl i?j as follows. Assume the 
edge weight matrix of ij in (? is generated by (^J, 0) using the following (2g + l)-tuple: 

(k€[hY,k = (k 1 ,...,k g y,£ = (e 1 ,...,e g )), 

where ki,£i > 0, k 7^ and £ / 0. Then we add the following incident edges of v e : 

1. For each 6 G [</], we add fef, parallel edges from Uj j, to v e in all of which are labeled with C^; 

2. For each b G [5], we add 4 parallel edges from f e to Wj^ in all of which are labeled with C^; 

3. Assign the vertex weight vector G ^3 to v e . 

Finally, for every vertex % G V we use p to denote its vertex weight in Q. Assume p is generated by 
(^3,0) using three finite sets S\,S2 and ^3 of tuples. For each s = (k G [h]; k = (fei, . . . , k g )) in Si with 
fej > and k ^ 0, we already added a Type-L vertex Uj jS in i?j (which appears in i?j only). We add the 
following incident edges of Uj )S : 
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1. For each b G [g], add kb parallel edges from fj s to Wi^ in Ri, all of which are labeled with C®; 

2. Assign the vertex weight vector w^l G *P to Vi S . 

For every s = (k G [/t]; k = (ki, . . . , k g )) in S2, we already added a Type-R vertex Wj >s G We add the 
following incident edges of t> j )S in Rf. 

1. For each 6 £ [5], add kb parallel edges from u^j to Wj jS in all of which are labeled with C^; 

2. Assign the vertex weight vector G ^? to t>j )S . 

For every tuple s = (k G [/i]; k = (fci, . . . , k g );£ = . . . ,£ g )) in £3, we already added a Type-M vertex 
Vi tS in Ri. We add the following incident edges of Wj jS in Rf. 

1. For every b G [5], add fcf, parallel edges from un to Vj jS , all of which are labeled with C^; 

2. For every b G [<?], add parallel edges from Vi tS to u^;,, all of which are labeled with C®; and 

3. Assign the vertex weight vector G *P to Vi >s . 

It can be checked that the (undirected) subgraph spanned by Ri, for all i G [n], is connected. 

This almost finishes the construction. The only thing left is to add some more vertices and edges so 
that the out-degree of Ui A and the in-degree of Wi <a are the same for all i G [n] and a G [g]. 

To this end, we notice that for all i G [n] and a G [<?], both the out-degree of Uj a and the in-degree 
of ii?j a constructed so far are linear in the maximum degree of G, because all the parameters k%,l{ and 
the sets Si are considered as constants. As a result, we can pick a large enough positive integer M > 2 
which is linear in the maximum degree of G, such that 

M > the out-degree of and the in-degree of Wi^ a constructed so far, for all i and a. 

We now add vertices and edges so that the out-degree of Ui A and the in-degree of tt)j >a all become M. 

Let i G [n] and a G [<?]. Assume the current out-degree of is < M. Then we add M — k new 
Type-R vertices in i?j and add one edge from Ui^ a to each of these vertices. The vertex weights of all the 
new vertices are 1, and the edge weights of all the new edges are (recall that we are allowed to use 
the normalized version of C^, and this is actually the only place we use it). 

Similarly, assume the current in-degree of Wi^ a is k < M. Then we add M — k new Type-L vertices in 
Ri and add one edge from each of these vertices to Wi^ a . The vertex weights of all the new vertices are 1 
while the edge weights of all the new edges are C^. 

This finishes the construction of the new labeled directed graph gW = (GN.vN.fN). 

F.3 Proof of Equation flgD 

We start with the definition of nvw(£) , for any assignment £ : V = [n] — > [r] . 

First, for each a G [g], we let fj,^ denote the following positive r-dimensional vector: 

/4 a] = E (4 1] ) 2 • (4 a] ) A/ ~ 2 ' for ever y < e m. 

x&Ai 

For every a G [g], we let denote the following positive r-dimensional vector: 

^ ] = E (^ 1] ) 2 • (^ ] ) M ~ 2 ' for every 1 £ [r] - 
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Finally, we define nvw(^) as follows: 

nvw(o = n n 4w ■ 4(0' f ° r any ^ : v = ^ ~* ^ 

ie[n] ae[g] 

It is easy to check that nvw(£) > and the number of possible values of nvw(£) is polynomial in n. 
Now we prove equation flSJ) for k = 1: 

Z^{Q [1] )= £ wt(S,0-nvw(e). (9) 

£:V-)-[r] 

Let £ be an assignment from V to [r]. We use to denote the set of all assignments 4> '■ ~ * [ m ] 
such that for every edge uv in the subgraph spanned by Ri , i G [n] , we have 

<f>(u) G Afti) and <f)(v) G 

In other words, for all i G [n] and u G if v a Type-L vertex then (j>{v) G ^(j); if v is a Type-R vertex 
then (p(v) E ^£(i)> an d if f is a Type-M of -Rj, then 0(f) € ^f(i) H Equivalently, we can associate 

every vertex v G with a subset [/„ C [m], where 

1. If v appears in both Ri and Rj for some i ^ j G V = [n], and v is Type-R in Ri and 
Type-L in Rj, then U v = B^u\ n ^(j); 

2. Otherwise, assume v only appears in Ri for some i EV = [n]. Then 

(a) If v is Type-L, then U v = A^uy, 

(b) If v is Type-R, then U v = B^uy, and 

(c) If v is Type-M, then U v = B^u\ n ^(i), 

such that <f> G <3?g if and only if 0(u) G for all v G VW. In particular, = iff U v = for some 

By the construction, we know the subgraph spanned by Ri is connected, for any i G [n]. It implies 
that wt(^W, <p) / only if G $ 5 for a unique £ : V — >• [r]. As a result, we have 

= £ wtc^U) = £ £ wt (£ [11 ^)> 

and to prove ([9]) we only need to show that 

wt(t/t 1 ',0) = wt(£/,£) • nvw(£), for any assignment £ : y = [n] — > [r]. 

We use w^l to denote the weight of v G V^ l \ E% to denote the set of edges in £W labeled with C^, 
and Fi to denote the set of edges in EW labeled with DW, then we have 

e -twu) - e f n <i> n f n c £U w ) f n 
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By the definition of <l?g, if <3?£ 7^ 0, then every <p E <3?g satisfies 

C H = cJ* 1 • and = ■ 5^ 

<j)(u) ,<j>(v) 0(f) <l>(v) < jH 1i )></>(' u ) </ , ( n ) 4 > { v )' 1 

where (qM,^) is the representation of D^. As a result, we have 

e wwu) = e ( n -a., n ( n f n ^ 

Because € iff (/>(u) E U v for all u, we can express this sum of products as a product of sums: 

n h v , 

in which every H v , v E V~M, is a sum over <f>(v) E t^. 
Finally, we show the following equation: 

11 H v = wt{g,0-nvw(0- (10) 

This follows from the construction of C/M and the following observations: 

1. For each v e £ Rid Rj, which is added because of edge ij E E, it can be checked that the sum H Ve 
over U Ve = J?^(i) H ^Wj) is exactly £(■/), where F is the weight of ij in Q (as defined in (J7D). 

2. Let p denote the vertex weight of i £ V, which is generated using «Si,t>2 an d 53- Then we have 

p*w = n n h *,. n 

se<Si se52 sgSs 

3. For all i E [n] and a E [5], we have 

of}.-, = H v and = ■ 

4. Finally, it can be checked that H v = 1 for all other vertices in V~M, which is the reason we need to 
use the normalized matrices D'"' in the construction. 

F.3.1 Construction of C/W 

We can similarly construct for every k E [L]. 

The only difference is that, instead of Ui A and Wi t(1 , we add the following 2kg vertices in Rf. 

Ui t j >a and Wij t a, for all j E [ft] and a E [5]. 

We also connect these vertices by adding Akg edges, whose underlying undirected graph is a cycle. All 
these edges are labeled with CW. We also add extra vertices and edges so that the out-degree of Uij ja 
and the in-degree of t»i,j, a are M for all i E [n], j E [ft] and a E [<?]. It then can be proved similarly that 

Z^{G [k] )= £ wt(S,0-(nvw(0) fc . 
f:V->[r] 

This completes the proof of Lemma [2j 
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G Decidability 

In this section, we show that the rank condition is decidable in a finite number of steps. 



G.l A Technical Lemma 

We prove a very useful technical lemma. 

Lemma 10. Let L,n,m> 1 be positive integers. For every i € [L], let {a\ , . . . , ajj } be a sequence of n 
positive numbers; and let {bf\ . . . ,6^]} be a sequence of m positive numbers. If 

E II E II ^rai/fc 1 ,fe ) ... > fci>l l 

ie[n] j'6[i] iG[m] je[L] 

then m = n and there exists a one-to-one correspondence ir from [n] to itself such that 

af = 6jj i)} for all i G [n] and j € [L]. 

Proof. We prove it by induction on L. The base case when L = 1 is trivial. 

Assume the lemma is true for L — 1 > 1. Without loss of generality, we assume that {af , . . . , a|f' } 
and {fef , . . . , are already sorted: 

of 1 > . . . > 4f ] > and &f 1 > . . . > > 0. 

We let s > 1 and i > 1 be the two maximum integers such that 

of! = of 1 = • • • = o W = a > and b[ L] = b[ L] = ■ ■ ■ = bf ] = b > 0. 

First it is easy to show that a = b. Otherwise assume a > b, then we set k\ = ... = = 1, divide 
(a) kL from both sides, and let kL go to infinity. It is easy to check that the left side converges to 

e n -? ] >°> 

ie[s] je[L-i] 

while the right side converges to 0, which contradicts the assumption. 

Second, we fix ki, . . . , £;_l_i to be any positive integers, divide (a) kL = {b) kh from both sides and let 
kL go to infinity. It is easy to check that the left side converges to 



e n 

te[s] je[L-i] 



aF 1 



while the right hand side converges to 



e n ^ 

ie[t] je[L-i] 



So these two sums are equal for all k±, . . . , > 1. Then we apply the inductive hypothesis to claim 
that s = t and there exists a permutation ir from [s] to itself such that 

af = &J| for all j £ [L — 1} and i G \s\. (11) 

It is also easy to see that for any i 6 [s], (fTTj) also holds for j = L. 

We then repeat the whole process after removing the first s elements from the 2L sequences. □ 



30 



Additionally, we also need the following simple lemma in the proof. 

Lemma 11. Let m > 1 be an integer and (Pi, P2, ■ ■ . , ) be a sequence of subsets of [m]. If for any finite 
subset {«!,..., Zfc} C N, Pi x fl Pj 2 fl ■ ■ ■ fl 7^ 0, i/ien i/iere exists a j G [m] such that j G Pj /or all i. 

Proof. If for every j G [m] , there exists some > 1 such that j g" P; Lj , then the finite intersection 

m 

n ^ = > 

which contradicts the assumption. □ 
G.2 Matrix and Vector Polynomials 

Let (X, 2)) be a generalized P-pair, for some m x m pattern P. So every vector w € X is either positive 
or V-weakly positive and every D G 2) is either a V-matrix or a V -diagonal matrix. Note that if 2) only 
has P-matrices, then (X, 2J) is a P-pair. The definitions below also apply to P-pairs. 
We say / is a V-matrix polynomial if / is a polynomial over variables 

{x id :(i,j) eP} 

with integer coefficients and zero constant term. We say 2) satisfies / if for every P-matrix D G 2J ; we 
have /(D) = 0, in which we substitute Xij by Djj > for all (z,j) G P. We also say (X, 2J) satisfies / if 
2J satisfies /. 

We say / is a V-diagonal matrix polynomial if / is a polynomial over variables 

[ Xi : (i,i)€V} 

with integer coefficients and zero constant term. We say 2J satisfies / if every P-diagonal matrix D G 2J 
satisfies /(D) = 0. We also say (X, 2J) satisfies / if 2J satisfies /. 

We say g is an m-vector polynomial if g is a polynomial over variables 

{ W :i€[m]} 

with integer coefficients and zero constant term. Similarly, we say X satisfies g if every positive vector 
w G X satisfies g(w) = 0. We also say (X, 2J) satisfies g if X satisfies g. 

Finally, we say g is a V-weakly positive vector polynomial if g is a polynomial over variables 

[yi ■ (i,i)€V] 

with integer coefficients and zero constant term. We say X satisfies g if every P-weakly positive vector 
w G X satisfies g(w) = 0. We also say (X, 2J) satisfies g if X satisfies g. 

Let F be a finite set of P-matrix, P-diagonal matrix, m-vector, and P-weakly positive vector poly- 
nomials. Then we say (X, 2J) satisfies F if (X, 2J) satisfies every polynomial / G F. 

Similarly, given any block pattern T, we can define T-matrix polynomials, T-diagonal matrix poly- 
nomials, and T-weakly positive vector polynomials for T-pairs and generalized T-pairs. 

We remark that, for the case when (X, 2J) is a T-pair, to check whether 2J satisfies the rank condition 
(i.e., every matrix D G 2J is block-rank-1), one only needs to check whether 2) satisfies all the T-matrix 
polynomials fi,i>,jj' of the following form 

fi,i>,j,j>(x) = Xij ■ Xi> tj > - Xiji ■ Xi'j, where G A k and j,f G B k for some k G [r]. 
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G.3 Checking Matrix and Vector Polynomials 



Now let (X, 2)) be a T-pair for some non-trivial m x m block pattern T = {{A\,B{), . . . , (A r ,B r )} with 
r > 1. We also assume that every matrix in 2) is block-rank- 1, and X is closed. 
We can apply the gen-pair operation to get a new P-pair 

(X', 2)0 = gen-pair (X, 2J), where V = gen(T). 

We also let (X*, 2)*) denote the generalized P-pair defined in AppendixO By definition, X* is also closed. 

In this section, we first show that to check whether (X*,2J*) satisfies a matrix or vector polynomial, 
one only needs to check finitely many polynomials for (X, 2J). One can prove a similar relation between 
(X',2)') and (X*,2)*). As a result, to check whether (X',2)') satisfies a polynomial or not, we only need 
to check finitely many polynomials for (X, 2J). 

We start with the following lemma. 

Lemma 12. Let f be a V -matrix or V-diagonal matrix polynomial. Then one can construct a finite set 
{F\, . . . , Fl} in a finite number of steps, in which every Fi, i € [L], is a finite set of T -matrix, m-vector, 
and 7" -weakly positive vector polynomials, such that 

(X*,2JP) satisfies f 3i G [L] Vg € F i: [(X,2J) satisfies g\. 

Proof. We first prove the case when / is a "P-matrix polynomial. 

If / is the zero polynomial, then the lemma follows by setting L = 1 and F\ to be the set consists of 
the zero polynomial only. From now on we assume that / is not the zero polynomial. 

Let {CW, . . . , CW} and {D^, . . . ,D®} be two finite subsets of T-matrices in 2J and {w^,. . . , w^} 
be a finite subset of positive vectors in X, where s,t,h > 1. We also let (aW,/3^) and (-yW,<5^) denote 
the representations of and D^, respectively. By the definition of 2J* and the assumption that 2) is 
closed, we can construct from every (s + t + /i)-tuple 

p = (ki, k s Ji, ... ,£t,e 1} ... ,e h ), where ki,£i,ei > 1, 

the following P-matrix in 2)*: the (i,j)th entry of C' p l is 

E O^f • • • (^ ] f • W 1 • • • (^r • KT 1 • • • (HT' for a11 *>* G m- (12) 

This follows from the fact that the Hadamard product of (wM) ei , . . . , (w^) 6 ' 1 is actually a vector in X, 
because X is known to be closed. 

Now we assume (X*,2J*) satisfies /, then by definition we must have 

/(CW) = 0, for all p, (13) 

since is a P-matrix in 2)*. By combining (|13|) and (|12p and rearranging terms, we have 



e inw-i 1 



n 



^hv j 



n /*(*■■■ 



U6[ 



n (^(/3F ] ,...,A yi 



n 0K b ' < N 



vie[. 
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for all p. In the equation above, n% and are two non-negative integers. For all i G [n\] and j G [712], 
both fi(xi, . . . , x m ) and gj(xi, . . . , x m ) are monomials in x\, . . . , x m . Also note that all the monomials 
fi,gj only depend on the V- matrix polynomial / but do not depend on the choices of p and the subsets 
{CW,...,CW}, {dW,...,dW}, and {wW,...,wW}. Moreover, because we assumed that / is not the 
zero polynomial, at least one of n\ and is nonzero. 

It follows directly from Lemma PTU1 that if (X*,2J*) satisfies /, then we must have n\ = 712 which we 
denote by n. (If n\ 7^ n-z, then we already know that /(C^) = cannot hold for all p. The lemma then 
follows by setting L = 1 and F\ to be the set consisting of the following m-vector polynomial: g(x) = x% 
so that (X, 2J) does not satisfy Fi.) Moreover, by Lemma [T0| if (X*,2)*) satisfies / then there also exists 
a permutation ir from [n] to itself such that 





• • j Pm ) 


= g<n{i 


)(*V. 


■ • > /^m ) j 


for all j G [s] and z G [n] ; 


Hi?,- 


• • ) im ) 


= g-K{; 


o(7i b V 


• • ) Im J 1 


for all j £ [t] and i G [n]; and 


i(w?,.. 


■ ) w m ) 


= g-w{i) 




w \j]\ 


for all j € [h] and i G [n]. 



Since all the discussion above and all the monomials /j,<?i do not depend on the choice of the three 
subsets, we can apply Lemma [TT1 to claim that if (X* ,2)*) satisfies /, then there must exist a (universal) 
permutation ir from [n] to itself such that for all D G X (since (X, 2)) is a T-pair, D is a T-matrix), 

fi(ai, . . . ,a m ) - sv(i)(ai, . . . ,a m ) = 0, for all i G [n] and 

/i(/3i, . . . ,/3 m ) - g n (i)(Pi, ■ ■ ■ ,P m ) = 0, for all i G [n], 

where (ct,/3) is the representation of D; and for every positive vector w G 2J, 

fi(wi, . . .,w m ) - g w (i)(wi,. . .,w m ) = 0, for all i G [n]. 

It is also easy to check that these conditions are sufficient. 

Furthermore, a and (3 can be expressed by the positive entries of D as follows. For every i G A^, 
where k G [r], let d be the smallest index in B^, then we have 

For every % G -Bfc, where fc G [r], let d be the smallest index in A/., then fa = D^i/a^- Now it is easy 
to see that for every permutation tt from [n] to itself, we can construct a finite set F n of T-matrix and 
m-vector polynomials, such that, if (X*,2J*) satisfies / then (X, 2J) satisfies F n for some ir. 

The case when / is a 'P-diagonal matrix polynomial can be proved similarly. The only difference is 
that every F n is now a finite set of T-matrix and T-weakly positive vector polynomials. □ 

It also follows directly by definition that 2J' satisfies a V- matrix polynomial if and only if 2J* satisfies 
the same polynomial, because 2}' contains precisely all the P-matrices in 2J*. Next, we deal with vector 
polynomials. 

Lemma 13. Let g be an r-vector or a V-weakly positive vector polynomial. One can construct a finite 
set {Gi, . . . , Gl} in a finite number of steps, in which every Gi is a finite set of T-matrix, m-vector, and 
T-weakly positive vector polynomials, such that 

(X*,2J*) satisfies g 3i G [L] V/ G G h [(X,2J) satisfies f] . 
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Proof. We only prove the case when g is P-weakly positive. The other case can be proved similarly. 
Again, we assume that g is not the zero polynomial. 

Recall that when defining X* in Appendix EH we first define X* and X* is then the closure of X*: w 
is a P- weakly positive vector in X* if and only if there exist a finite and possibly empty subset of positive 
vectors {wM, . . . , w^} C X* for some s > 0, a finite and nonempty subset of P- weakly positive vectors 
{uW, . . . ,uW} C X* for some t > 1, and positive integers k\, . . . , k s , £\, . . . , £ t , such that 

w = (wW) fcl o • • • o ( w H) fes o ( U N)* o . . . o ( U M) 4 

To prove Lemma [T3l we first construct a finite set {Pi, . . . ,Fm}, in which every Fi is a finite set of 
r-vector and P-weakly positive vector polynomials, such that 

X* satisfies g <J=> 3 i G [M] V/ 6 F h [X # satisfies /] . (14) 

To this end, we let {w^, . . . , w^} be a finite subset of positive vectors in X*; and {uW, . . . , u^} be a 
finite subset of P-weakly positive vectors in X^, with s > and t > 1. Then from any tuple 

p = . . . , k s ,£t, . . . ,£ t ), where ki,£i > 1, 

we get a "P-weakly positive vector wt p ] £ X*, where 

W [ P ] = (w [i])^ . . . ( W H)^ ( u [i]^i . . . ( U M)4_ 

Assume X* satisfies g, then we have ^w^) = for all p. Combining these two equations, we have 

e f n (/.(w^f) f n (/.("«))") = e fn (*(»»))") f n («.(»«))* 

ie[ni] \je[s] / \je[t] J ie{n 2 ] \je[s] J \ja\t\ 

for all p. In the equation, /«(x) and <7i(x) are both monomials over X{, G V. Again, /, and gi only 
depend on the polynomial g but do not depend on the choices of p and the two subsets {wN, . . . ,wW} 
and { U W,...,uM}. 

Because g is not the zero polynomial, one of n\ and ri2 must be positive, and we have the following 
two cases. If n\ ^ ri2, then by Lemma [TUl X* cannot satisfy g and (|14p follows by setting L = 1 and F\ 
to be the set consists of the following r-vector polynomial: /(x) = x\. 

Otherwise, we have ri\ = n2> 0, which we denote by n. It follows from Lemma [TUl and Lemma [TT| 
that if X* satisfies g, then there exists a universal permutation ir from [n] to itself such that for every 
positive and P-weakly positive vector w € X*, 

/i(w) = ff,r(i)(w), for all ie[n]. 

As a result, we can construct F n for each ir, and X* satisfies g if and only if X* satisfies F n for some 7r. 

In the second step, we show that for any r-vector or P-weakly positive vector polynomial /, one can 
construct {F\, . . . , F^} in a finite number of steps, in which each Fi is a finite set of T-matrix, m- vector 
and T- weakly positive vector polynomials, such that, X* satisfies / if and only if (X, 2)) satisfies F{ for 
some i G [L\. The idea of the proof is very similar to the proof of Lemma [12] so we omit it here. 

Lemma [TBI for the case when g is P-weakly positive, then follows by combing these two steps. □ 
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We can also prove the following lemma similarly. 



Lemma 14. Let g be an r-vector or a V-weakly positive vector polynomial. Then one can construct a 
finite set {G\, . . . , Gl} in a finite number of steps, in which every Gi, i G [L], is a finite set of V -matrix, 
V -diagonal matrix, r-vector, and V-weakly positive vector polynomials, such that 

(X',2)') satisfies g 3i G [L] V/ G G i} [(X*,2)*) satisfies f] . 

G.4 Decidability of the Rank Condition 

Finally, we use these lemmas to prove Lemma 0J the decidability of the rank condition. 

We start with the following simple observation. Let F = {/i, . . . ,/ s } be a finite set of matrix and 
vector polynomials. For each i G [s], there is a finite set i, ■ ■ ■ , Fi ^} in which every F^j is some finite 
set of polynomials, and we have the following statement: 

(X',2)') satisfies /< <=► 3 j G [L f ] V/ G Fy, [(X,2J) satisfies /] . 

Then the conjunction of these statements over /j G F, i G [s], can be expressed in the same form: One 
can construct from {F^j : i G [s], j G [Lj]} a new finite set {G±, . . . ,Gl} in which every Gj is some finite 
set of polynomials, such that 

V/ G F, [(X', 2)') satisfies /] 3j G [L] V 5 G Gj, [(X, 2J) satisfies 5 ] . 

Now we prove Lemma [U After i > steps, we get a sequence of £ + 1 pairs 

(X ,2Jo),(X 1 ,2J 1 ),...,(X,,2J,), 

which satisfies condition (R^). Since we assumed that Xo = {1}, every Xj in the sequence is closed. 
We show how to check whether every matrix D G 2)^ + i, where 

(Xe+l,Z)t+l) = gen-pair(Xf,2)£), 

is block-rank- 1 or not. To this end we first check whether V = gen(7^) is consistent with a block pattern 
or not. If not, then we conclude that %)e+i does not satisfy the rank condition. 

Otherwise, we use 7^+i to denote the block pattern consistent with V . To check the rank condition, 
it is equivalent to check whether 2}£ + i satisfies the following "P-matrix polynomials: 

fi,i',j,j'{x) = x%,j • — ' x i',ji where i,i G and j,j G for some k G [r] 

and (A\,Bi), . . . , (A r ,B r ) are the pairs in 7i+i- 

By Lemma [T2lll4( we can construct a finite set {F\ , . . . , Fl } in which every Fi is a finite set of 

7^-matrix, m^-vector, and 7^-weakly positive vector polynomials 

such that 

2)^4-1 satisfies the rank condition if and only if satisfies Fi for some i G [L\. 
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If £ = 0, then we are done, since (Xq, 2)o) is finite and we can check all the polynomials in Fi for all i € [L] 
in a finite number of steps. Otherwise, £ > 1 and we can use Lemma [1211141 and the observation above to 
construct, for each Fi, a finite set {Fi 1, . . . , Fm} in which every F$j is a finite set of 

7^-i-matrix, m^_i-vector, and 7^-i-weakly positive vector polynomials 

such that 

(%e,%)i) satisfies F, if and only if (X^_i,2)^_i) satisfies Fij for some j £ [Li]. 

We repeat this process until we reach the finite pair (Xo,2)o)- So the checking procedure looks like 
a huge tree of depth £ + 1. Every leaf v of the tree is associated with a finite set F v of 

7o-matrix, mo-vector, and 7o-weakly positive vector polynomials. 

Set 2)^+i satisfies the rank condition if and only if (Xo,2)o) satisfies F v for some leaf v of the tree. 

H The Dichotomy for the {0, 1} Case 

We briefly describe the dichotomy criterion of Bulatov [2] . 

A finite relational structure T~L over a finite set of relational symbols R\, R2, ■ ■ ■ , Rk, each of which 
has a fixed arity, is a non-empty set H together with an interpretation of these relational symbols R^, 
R2, . . . , Rj^ which are relations on H of the corresponding arities. For graph homomorphism (i.e., H- 
coloring), we start with a single binary relation, namely the edge relation E on H. A relation R is said 
to be pp-definable in %, if it can be expressed by the relations R^, 1 < i < k, together with the binary 
Equality predicate on T~L, conjunction, and existential quantifiers. 

A mapping / from H m to H, for some m > 1, is called a polymorphism of 7~L if it satisfies the following 
condition: For any relation R € {R\, R^, • • • , R^} of arity n, for any m tuples in H n : 

(ai } 1 , . . . j ftl ; n) 3***3 (&m,l 1 • • • 5 ^m,n 

if each (o$ 1, . . . , a«,n) G -R for all i : 1 < i < m, then 

,1 > • • • > Q.m,l ),...,/(ai ))eR. 

A relational structure % defines a universal algebra A, where the universe is -ff and the set of all poly- 
morphisms are its operations. A theorem of Geiger then states that a relation on H is invariant under 
all polymorphisms iff it is pp-definable. 

A pp-definable binary equivalence relation is called a congruence. A subalgebra is a unary pp-definable 
relation (subset) together with the restrictions of the given relations. One can easily define direct product 
algebras and homomorphic images (quotient algebra modulo a congruence) . A class of universal algebras 
closed under quotient, subalgebra and direct product is called a variety. The class of algebras that are 
homomorphic images of subalgebras of direct powers of some universal algebra is called the variety gene- 
rated by it (HSP theorem). 

A Mal'tsev polymorphism m is a ternary polymorphism satisfying m(x, x,y) = y and m(x, y, y) = x, 
for all x,y € H. Having a Mal'tsev polymorphism is a necessary condition for tractability. 

Now start with the relational structure T~L with a single edge relation E, then add to it all the unary 
relations {Ch \ h G H}, where = {(h)}, we obtain a relational structure denoted by H-^- Then 
the polymorphisms of Hid define the universal algebra called the full idempotent reduct. These are the 
idempotent polymorphisms of H: f(x, . . . ,x) = x. 
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Congruences form a lattice. Given any two congruences a and f3, we let Ai, . . . , A s and B\, . . . , Bt be 
the equivalence classes of a and /3 respectively, then the s x t matrix M(a, f3) has (i, j) entry |.Aj n Bj\. 

The tractability criterion of Bulatov can now be stated: Start with Hid and take the full idempotent 
reduct. The #CSP problem defined by T~L is tractable iff every finite algebra A in the variety generated 
by this full idempotent reduct satisfies the following condition: For any two congruences a and (3 in A, 
the rank(M(a, /?)) is equal to the number of equivalence classes of a V (3, the join congruence of a and (3. 

The reason it is difficult to show that this dichotomy criterion is decidable is because it talks about 
all finite algebras A in the variety generated by the full idempotent reduct of Hid- This variety is infinite, 
containing arbitrarily large arities over H. Thus, even though in graph homomorphism we are given only 
a binary relation, the process of forming the variety produces arbitrarily large arities, and this criterion 
is a condition involving infinitely many relations. 
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